DEVICE FOR DISPLAYING LINK INFORMATION AND 
METHOD FOR DISPLAYING THE SAME 




BACKGROUND OF THE INVENTION 
Field of the Invention 

The present invention relates to a link information 
display device for obtaining the image signal of an actual 
object by an imaging device or an image recorder, and receiving 
link information on the actual object transmitted by a link 
information transmitter, thereby displaying the link 
information superimposed on the image signal of the actual 
ob j ec t . 

Description of the Related Art 

In recent years, there has been overspread a method in 
which a technique such as WWW (World Wide Web) for transmitting 
and receiving information on the Internet, or MPEG4 (Moving 
Picture Expert Group4 ) for compressing and reproducing moving 
pictures is used to embed a hyperlink label into a suitable 
position of a text, still image or moving image, whereby the 
user performs a predetermined operation for this hyperlink 
label, so as to easily obtain hyperlink information associated 
with the label. The hyperlink label herein is referred to as 
a character string configuring URL (Uniform Resource Locator) 
for use in, e.g., HTTP (Hyper text Transfer Protocol). 
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Information associated with the hyperlink label, e.g., 
information such as the link contents, link attribute, and 
link position is called hyperlink information . For convenience, 
the hyperlink label is hereinafter referred to simply as a 
link label, and information associated with the link label 
is described as link information. 

Definition on format is currently made to embed a link 
label into an image or a moving picture. How link information 
associated with a link label to be embedded is generated is 
being studied and developed. 

In the field of Augmented Reality, there have been 
advanced studies for adding information of a virtual world 
to the real world. 

Among them, a method capable of obtaining information 
on an actual object has been also proposed. For example, it 
is possible to provide means for displaying, on an image display 
device, link information superimposed on the image signal of 
an actual object filmed by an imaging device and associated 
with the actual object, whereby the user can easily obtain 
the information on the actual object. 

The foregoing prior art includes any one of the problems 
as described below. There has not been a method for solving 
these at the same time yet. Obtainable information is an ID 
{ identif icat ion number ) of an object. The ID must be separately 



converted to link information, specifically, URL. For this 
reason, an information obtaining side must always prepare 
database indicating association of the ID with the link 
information . 

As for the positional information of an object, for 
example, only the extent that in which room an object is present 
can be recognized, and the precise position or direction of 
the object cannot be recognized. 

Further, an ID is recognized by image processing a tag 

□ provided in an object. The user must thus be in a position 
*P 

*5 to recognize the tag. 

?S 

N Furthermore, only the information on an object itself 

u 
i — 

^1 provided with a tag into which an ID is written can be obtained. 

F\ To obtain information on another object, the object must be 

p also provided with a tag. There is also the disadvantage that 

ru 

□ a link label moving in the space cannot be expressed. 



SUMMARY OF THE INVENTION 
The present invention has been made in view of such 
circumstances, and an object of the present invention is to 
provide a device for displaying link information and a method 
for displaying the same, which can display the label of link 
information received by a receiver superimposed on the image 
of an actual object to easily obtain information on the actual 
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object, and also display a moving link. 

To achieve the foregoing object, a link information 
display device of the present invention for displaying link 
information transmitted by a link information transmitter, 
comprises image input means for obtaining an image signal, 
receiving means for receiving the link information, 
synthesizing means for superimposing the received link 
information on the image signal, and display means for 
displaying the image signal synthesized. 

In the present invention, preferably, the image input 
means comprises an imaging device for imaging the image signal 
of an actual object, or an image signal reproducing device 
for reproducing an image signal stored onto an image recording 
medium . 

The present invention preferably comprises attribute 
information detection means for detecting attribute 
information from the received link information, and selection 
means for, when the link information transmitter transmits 
a plurality of pieces of link information, selecting 
predetermined link information in accordance with the 
attribute information detected by the attribute information 
detection means. 

The present invention preferably compri ses 1 ink pos i tion 
detection means for detecting link position information from 




the received link information, and coordinate conversion means 
for determining a display position to display the link on the 
display means inaccordancewith the link posi t ion information . 

In the present invention, preferably, the coordinate 
conversion means calculates a display position to display the 
link on the display means in accordance with the link position 
information and the position of the transmitter. 

In the present invention, preferably, the display means 
lines up and displays these pieces of link information in 
predetermined positions on the display screen when a plurality 
*jj of pieces of link information are displayed. 

A link information display method of the present 
invention for displaying link information transmitted by a 

□ link information transmitter, comprises the steps of: 

'-"4 

p obtaining an image signal; 

in 

P receiving the link information; 

superimposing the received link information on the image 
signal; and 

displaying the image signal superimposed with the link 
information . 

The present invention preferably comprises a step of 
storing the image signal superimposed with the link 
information . 

Thus, there are provided a device for displaying link 
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information and a method for displaying the same according 
to the present invention, which needs not to have database 
associated with geographic information, e.g., information 
such as a map, can supply hyperlink information associated 
with an actual object in an optional coordinate position in 
the space to the user by a convenient method, and display 
hyperlink information on a moving object on, e.g. , the screen 
of the display device in accordance with the movement of the 
moving object, whereby the user can conveniently obtain 
information on an object in the real world. 

Further, according to the present invention, in place 
of an object incapable of being provided with a transmitter 
which physically transmits link information, a transmitter 
in a position spatially away from the object substi tutably 
transmits hyperlink information on the ob j ect, so as to provide 
link information of the object incapable of being provided 
with a transmitter. 

Furthermore, link information can be selected in 
accordance with the attribute information of the link 
information, based on the request of the user, thereby 
supplying to the user only the link information belonging to 
a predetermined category. 



BRIEF DESCRIPTION OF THE DRAWINGS 
FIG.l is a block diagram showing one embodiment of a 

link information receiver according to the present invention; 

FIG. 2 is a diagram showing one construction example of 

a system including the link information receiver of the present 

invent ion ; 

FIG. 3 is a diagram showing the construction of a system 
when a transmitter transmits link information provided with 
the transmitter; 

FIGS.4A to 4C show a screen of the display part of the 
receiver of the system shown in FIG. 3; 

FIG. 5 is a diagram showing the construction example of 
a system when the transmitter transmits link information in 
a position away from the transmitter; 

FIGS.6A and 6B show the screen of the display part of 
the receiver of the system shown in FIG. 5; 

FIG. 7 is a diagram showing the construction example of 
a system when the transmitter transmits a plurality of pieces 
of information; and 

FIGS . 8A to 8D show the screen of the display part of 
the receiver of the system shown in FIG. 7. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
FIG.l is a block diagram showing one embodiment of a 



link information display device according to the present 
invention . 

As illustrated, the link information display device of 
this embodiment has a link information receiving part 10, a 
link contents detection part 20, an attribute information 
detection part 30, a link position detection part 40, a 
transmitting position detection part 50, a coordinate 
conversion part 60, a selection part 70, a synthesizing part 
80, a display part 90, a storing part 100, and an image input 
Q part 110. 

'3 The parts for constructing the link information display 

device of this embodiment will be described. 

j=y The link information receiving part 10 receives link 

t; 

□ information transmitted by a link information transmitter, 

□ not shown. The link information transmitter transmits to the 

lU 

O surroundings link information on one or a plurality of objects 

through a transmission path such as an electric wave. The link 
information receiving part 10 receives an electric wave signal 
transmitted by the link information transmitter, and then, 
demodulates and decodes the receiving signal in accordance 
with the coding system and modulation system for use in the 
link information transmitter, thereby supplying the receiving 
signal to the link contents detection part 20, the attribute 
information detection part 30, the link position detection 
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part 40, and the transmitting position detection part 50. 

The link information transmitted by the transmitter will 
be described here. The link information is constructed of 
information indicating the link contents, attribute 
information, and link position. 

The link contents consist of, e.g., data indicating a 
1 ink destination , e.g., information such as a character string 
configuring URL. By way of example, the link contents consist 
of data information indicating an address on the network of 
an information providing server holding information on a 
certain object, e.g., a character string of a web address 
"http : / /dreams i te .net.com/" . 

The attribute information i s added to a 1 ink . For example , 
the attribute information adds a name with a character string 
"dream home page" to the web address 

"http://dreamsite.net.com/", and displays the color of a link 
or the category of link destination information. 

The link position is positional information when 
considering that a link is present virtually in the space. 
For example, the parallel or rotational movement of a link 
coordinate system CI viewed from a coordinate system Ct of 
the transmitter is expressed by a 4 X 4 array using a homogenous 
coordinate system. 

The homogeneous coordinate system here is a coordinate 



display system for expressing, e.g., a point [x, y] in the 
two-dimensional space as [x, y, 1] . A point [x, y, m] in the 
homogeneous coordinate system expresses a point [x/m, y/m] 
in a normal coordinate system. Here, m acts as magnification; 
m = 0 expresses an infinite far point. 

In the two-dimensional homogeneous coordinate system, 
coordinate conversion, e.g., parallel movement and rotation 
can be expressed in a form of a 3 X 3 conversion array. 

In the homogeneous coordinate system of the 
three-dimensional space, a point [x, y, z] can be expressed 
as [x, y, z, 1] . In the three-dimensional homogeneous 
coordinate system, coordinate conversion such as parallel 
movement and rotation can be expressed in a form of a 4 X 4 
conversion array. 

The link information is constructed of a combination 
of the elements of the above - mentioned link contents, attribute 
information, and link position information. Part of these, 
however, may be omitted. For example, the link information 
may be constructed of only the link contents or only the 
attribute information. 

The link information transmitter, not shown, has, for 
example, a link contents generation part for generating the 
link contents, a link position generation part for generating 
a link position, an attribute information generation part for 



10 



generating attribute information, a multiplexing circuit for 
multiplexing information generated by these, and a 
transmitting circuit for transmitting the multiplexed 
information, by means of, e.g., an electric wave. The link 
position information is positional information when 
considering that a link is present virtually in the space, 
as described above. The link position information is, e.g., 
information indicating the space position of the link 
coordinate system CI viewed from the coordinate system Ct of 
the transmitter, or information indicating the space position 
of the link coordinate system CI viewed from a link coordinate 
system Cg of a third object as a reference for determining 
a position for both transmission and reception. 

Transmission of the link information is not limited to 
use of an electric wave, and may be performed using other 
transmi ss ion methods , e.g., magnetism, an infrared ray or the 
like. The link information may be transmitted continuously 
timewise, or may be repeatedly transmitted at fixed intervals . 

The link information transmi t ted by the link information 
transmitter is received by the link information receiving part 
10 . The receiving signal is then outputted to the link contents 
detection part 20, the attribute information detection part 
30, the link position detection part 40, and the transmitting 
position detection part 50. 
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When transmitting and receiving the link information, 
there is employed a radio system grasping the positional 
relation between the transmitter and the receiver, e.g., a 
system for modulating and demodulating, or a system for coding 
and decoding a signal determined by a radio protocol for use 
in the transmitter. In other words, the positional relation 
between the coordinate system Ct of the transmitter and the 
coordinate system Cr of the receiver (parallel or rotational 
movement) is determined by the signal received by the link 
information receiving part 10. For example, there are 
considered GPS (Global Positioning System) , a method for 
measuring distances or directions for use in radio navigation, 
and application of a detection technique using magnetism as 
well as an electric wave. 

The link contents detection part 20 detects the link 
contents from the receiving signal to output the link contents 
to the selection part 70. 

The attribute information detection part 30 detects the 
attribute information from the receiving signal to output the 
attribute information to the selection part 70. 

The link position detection part 40 detects the link 
position information from the receiving signal to output the 
link position information to the coordinate conversion part 
60 . 
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The transmitting position detection part 50 obtains from 
the receiving signal the positional relation between the 
coordinate system Ct of the link information transmitter and 
the 1 ink information receiver to output the posi tional relation 
to the coordinate conversion part 60. 

The coordinate conversion part 60 combines the link 
position information from the link position detection part 
40 with the positional relation information from the 
transmitting position detection part 50 so as to convert the 
link position information to the coordinate system Cr, thereby 
converting the linkposition information toacoordinate system 
Cs when the link information is finally displayed on the display 



m 
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fU part 9 0 



At this time, when only the presence or absence of the 
0 link is important and the precise position is not required, 

P the link information may be converted to a convenient position 



to display it on the display part 90. For example, when the 
link information is displayed on the screen of the display 
part 90, and it is desired to indicate only that the link is 
present ina range displayed on the screen, the link information 
may be lined up at the right end or the left end on the screen. 
Further, considering the rotational movement of the link, the 
link information is positioned in the hard-to-read direction, 
the link information may be viewed horizontally on the screen. 
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The selection part 70 selects the inputted link 
information to be passed to the synthesizing part 80, based 
on the link attribute information from the attribute 
information detection part 30. It is possible to categorize 
the links based on the attribute information and to display 
only the link in the necessary category. 

The image input part 110 inputs the image signal of an 
object. For example, the image input part 110 supplies an image 
signal filming an actual object by a video camera to the 
synthesizing part 80. In addition, the image input part 110 
can obtain an image signal read from an image recording medium 
such as a magnetic tape or optical disc by an image signal 
recorder, not shown, so as to supply the image signal to the 
synthesizing part 80. 

The synthesizing part 80 superimposes, on the image 
signal supplied from the image input part 110, the link 
information inputted from the selection part 70, e.g., the 
link contents in the display position of the link label 
expressed by the coordinate system Cs in accordance with the 
attribute information. For instance, when the attribute 
information includes a color of the link, the link label is 
drawn in a sui table color tobe superimposed on the image signal . 

The display part 90 is, e.g., a display device having 
a screen for displaying an image, and displays the image signal 
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from the synthesizing part. The inherent coordinate system 
Cson thescreenof the display part 90 is determined previously . 
The coordinate conversion part 60 calculates a coordinate value 
in the screen coordinate system Cs of the link coordinate, 
in accordance with the link position obtained from the link 
position detection part 40 and the positional relation between 
the transmitterandthe receiver obtained from the transmitting 
position detection part 50 . The synthesizing part 80 generates 
a synthesizing image signal for displaying the link contents 
superimposed on the image signal in accordance with the 
coordinate value calculated. 

The storing part 100 stores the image signal generated 
by the synthesizing part 80 onto a predetermined recording 
medium . 

FIG. 2 is a diagram showing one construction example of 
a system using the receiver shown in FIG.l 

As illustrated, the system has a transmitter 150, a 
receiver 16 0 , and an actual object 180. A link 170 is hyperlink 
information associated with one point in the space. A screen 
200 shows, e.g., a display screen for displaying the image 
signal in the receiver 160. 

The transmitter 150, the receiver 160, and the link 170 
have respectively inherent coordinate systems Ct, Cr and CI. 
The coordinate sys terns can form an optional pos i t ional relation 
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each other in the space . The coordinate system Cs of the screen 
200 bears a fixed relation to the coordinate system Cr of the 
receiver 160. The set of the receiver 160 and the screen 200 
envisages that a video camera is incorporated into the receiver. 
In this case, the image displayed on the screen 200 viewed 
from the viewpoint of the receiver 160 shown in FIG. 2 can be 
regarded as the image imaged by the video camera. 

In FIG. 2, to prevent troublesomenes s , the system is 
simplified as follows. A typical system has a plurality of 
transmitters, receivers, and links. FIG. 2 shows only one 
transmitter, one receiver, and one link. Further, in the 
drawing, the coordinate system Cs of the screen 200 sets the 
origin at the upper-left side, but may set the origin in the 
center of the screen, or may set the origin so that the X axis 
and the Y axis are in different directions. 

The position of the viewpoint of viewing the screen 200 
coincides with the origin of the coordinate system Cr of the 
receiver, but may be in another position. Important is that 
the positions of the coordinate system Cr of the receiver and 
the coordinate system Cs of the screen bear a certain fixed 
relation . 

In the system shown in FIG. 2, the transmitter 150 
transmits link information associated with one point in the 
space, by, e.g., an electric wave. The receiver 160 receives 
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the link information. The image input part inputs, e.g., an 
image signal of the actual object 180 by a video camera. When 
the video camera is directed to the actual object 180, the 
image of the actual object 180 is displayed on the display 
screen of the display part provided in the receiver, that is, 
on the screen 200 shown in FIG. 2. 

Based on the link information received by the receiver 
160, a link label having a predetermined attribute and 
direction is displayed in a predetermined position on the 

□ screen 20 0 . When the user specifies the link label on the display 
W screen using a pointing device, e.g., a mouse or light-pen, 

^ information associated with the link label is displayed. For 

SJ 

l*y example, when a point as a noted place is associated with the 

;i 

P link 170 and the actual object 180 is a person, the image of 

Si 

13 the person and the link label of the link information associated 

m 

□ with the noted place transmitted by the transmitter 150 are 
displayed on the screen. For this reason, the user specifies 
the link label so as to access the link information on the 
noted place, e.g., a home page describing the noted place in 
detail . 

For example, when a person provided with the transmitter 
150 is filmed, link information on the person superimposed 
on the image signal can be also displayed on the screen 200. 
In this case, the link coordinate system CI can be set to coincide 
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with the coordinate system Ct of the transmitter 150 (that 
is, Ct = CI) . In addition, generally, the link coordinate CI 
can be set in a position away from the transmitter 150 (that 
is, Ct=£ci) , as shown in FIG. 2. 

The operational example of this embodiment will be 
hereinafter described with reference to the drawings. 

First operational example 

First, a first operational example will be described 
with reference to FIG. 3. 

FIG . 3 shows an example in which the transmi t ter 150 itself 
is provided with the link 170 and transmits link information. 
In other words , as shown in FIG . 3 , the origin of the coordinate 
system Ct of the transmitter 150 coincides with the origin 
of the link coordinate system CI. At this time, the position 
of the link coordinate system CI viewed from the coordinate 
system Ct of the transmitter 150 includes only the component 
of the rotational movement, but not the component of the 
parallel movement. 

When the link information is filmed by the receiver, 
the image of the actual object 180, the physical image of the 
transmitter 150, and a link label provided in the transmitter 
150 are displayed on the screen, as shown in FIG.4A. 

In this case, in the event that the component of the 
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rotational movement allows the characters of the link label 
displayed on the screen to be hard to read, the coordinate 
conversion may be adjusted in the coordinate conversion part 
60 in the receiver 160 so that the link label is horizontal 
on the screen, as shown in FIG.4B. 

As shown in FIG.4C, when the transmitter 150 is mounted 
on a moving object, e.g., an automobile, the link label can 
be displayed on the screen in accordance with the moving 
automobile. In other words, in accordance with the change of 
the position of the moving object, e.g. , the automobile, the 
transmitted link position information is also changed 
accordingly. The link position information changed is 
converted to the coordinate system Cs of the screen by the 
coordinate conversion part 60 of the receiver 160. The link 
label displayed on the screen is changed in accordance with 
the physical image of the transmitter 150. 

Second operational example 

FIG. 5 shows an example in which the transmitter 150 
transmits link information in a position away from the 
transmitter 150. In this case, the positional information of 
the link 170 is generated and transmitted by the transmitter 
150 so that the link 170 is in a certain virtual position in 
the space. For example, as shown in FIG. 5, the link 170 is 



19 



generated and transmitted by the link position information 
transmitter 150 so as to be virtually in the position different 
from that of the transmitter 150. 

Suppose that the receiver 160 displays the actual object 
180 as the image signal obtained from the image input part, 
e.g., the image signal imaged by the video camera. In this 
case, a link label corresponding to the link 170 is displayed 
on the screen. At this time , the transmitter 150 is inaposi t ion 
different from the link position. The physical image of the 
transmitter 150 is not displayed on the display screen. In 
other words, as shown in FIG.6A, on the screen, in addition 
to the image of the actual object 180, the link label appears 
to be floated in the space. 

In addition to the image of the actual object 180, for 
example, as shown in FIG. 5, when a new object 182 is present, 
a coordinate system fixed to the object is Co. With respect 
to the object 182, the link position information transmitted 
by the transmitter 150 is (CI = Co) . The display part of the 
receiver 160 displays a link label provided with the image 
of the object 182, as shown in FIG.6B. 

Thi s method is used when the ob j ec t 182 cannot be provided 
wi th the transmi tter due to its smal 1 size. Thelink information 
of the object 182 is transmitted by the transmitter 150 
spatially away from the object 182; it can be regarded that 
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in place of the object disposed in a position away from the 
transmitter 150, the transmitter 150 subs t i tu tably transmits 
the link information thereof. 

When the positional information transmitted by the 
transmitter 150 is changed with time, a moving link label is 
displayed on the screen of the display device of the receiver 
160. For example, in FIG.6A, the positional information of 
the link coordinate system CI is changed with time so as to 
provide a visual effect so that the link label floated in the 
space appears to have a circular movement. Further, as shown 
in FIG.6B, when the position of the object 182 is changed, 
the positional information transmitted by the transmitter 150 
is changed in accordance with the change of the position of 
the object 182. Thus, the screen of the display part of the 
receiver 160 can obtain a visual effect of changing the display 
position of the link label in accordance with the object 182. 

Third operational example 

FIG. 7 shows an operational example when a plurality of 
pieces of link information are transmitted by the transmitter 
150. These pieces of link information are associated with the 
points in the respective spaces. As illustrated, the 
transmitter 150 transmits, e.g., three pieces of link 
information of links 170, 172 and 17 4 . The receiver 16 0 receives 
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the information of the transmitted links 170, 172 and 174. 
The screen of the display part displays link labels associated 
with the received link information, together with the image 
of the actual object 180. 

In this case, the display coordinate of the link label 
on the screen can be calculated precisely in accordance with 
each piece of the received link position information. The link 
labels associated with the links 170 and 172 can be displayed 
on the screen in accordance with the calculated results. On 
the other hand, the link label associated with the link 174 
is not displayed because it is not in the display range of 
the screen. As a result, for example, as shown in FIG.8A, in 
addition to the image of the actual object 180, two link labels 
are displayed. 

When a plurality of link labels are displayed on the 
screen in accordance with a plurality of pieces of link 
information and the link label is displayed in the coordinate 
position of each of the link labels calculated in accordance 
with each piece of the link position information, the screen 
may be hard to see in some cases. In this case, as shown in 
FIG. 8B, a plurality of link labels can be linedup and displayed 
at the right end or an easy-to-see suitable position on the 
screen. Thus, the link labels on the screen can be displayed 
understandably, and more pieces of link information can be 
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provided without giving a di scomf or tabl e feeling to the user. 

The link positioned outside the display range on the 
screen may be also displayed in a predetermined position on 
the screen. When the actual object is not displayed on the 
screen, the user can obtain link information on the object. 
For example, the link 174 is positioned outside the display 
range on the screen, but, as shown in FIG.8D, the link label 
(a link 3) of the link 174 may be included to be lined up and 
displayed at the right end. 

When the transmitter 150 transmits a plurality of pieces 
of link information, the receiver 160 can categorize a 
plurality of pieces of the link information in accordance with 
the attribute information of the received link information. 
Then , only the 1 ink information belonging to a desired category 
can be displayed on the screen of the display part. In other 
words, when the category as attribute information is described 
in a plurality of pieces of the link information transmitted 
by the transmitter 150, the link information can be categorized 
in accordance with the category of the attribute information, 
thereby displaying only the link information belonging to the 
category specified by the user. 

For example, in FIG. 7, suppose that the attribute 
information of the link 170 is provided with category = 
"personal information", and the attribute information of the 
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link 172 is provided with category = "store information". In 
selection and specification by the user, for example, store 
information is selected. The selection part 70 of the receiver 
160 selects only the link information provided in the attribute 
informat ion wi th category = " s tore information" to be ou tpu t ted 
to the synthesi z ing par t 8 0 . For thi s reason , as shown in FIG . 8C , 
the display part 90 displays only the link label associated 
with the link information provided with the category of "store 
information" . The user can draw out desired information in 
accordance with the link label displayed. 

As described above, according to this embodiment, the 
receiver which receives link information transmitted by the 
transmitter displays on the display device the image signal 
of an actual object obtained by the image input part and a 
link label associated with the received link information, and 
supplies to the user the image signal of the actual object 
and the link information on the actual object, thereby 
providing the user with necessary information by a more 
convenient method. 



24 



